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^  Abstract 

The  purpose  of  this  effort  was  to  implement  the  Modified  Monte  Carlo  tech¬ 
nique  using  Importance  Sampling  on  the  Block  Oriented  System  Simulator  (BOSS). 
In  this'thesis-,  computer  simulation  techniques  of  communications  systems  were  re¬ 
viewed.  Next,  conventional  Monte  Carlo  techniques  and  Modified  Monte  Carlo  tech¬ 
niques  using  Importance  Sampling  were  reviewed.  Models  of  Binary  Phase  Shift 
Keying  (BPSK)  systems  using  both  Monte  Carlo  techniques  were  implemented  and 
simulated.  Reasons  for  the  model  using  Importance  Sampling  not  working  correctly 
are  postulated. 

The  Monte  Carlo  technique  is  a  method  of  ensuring  that  an  inherently  infinite 
procedure,  such  as  determining  system  bit  error  rate  (BER),  can  be  determined 
within  an  appropriate  accuracy  and  a  confidence  range  after  a  set  number  of  samples. 
Conventional  Monte  Carlo  requires  10*'*'^  samples  be  generated  to  determine  a^BER, 
of  10“*'.  This  number  of  samples  results  in  an  estimated  BER  in  the  range  of  0.5  to  2.0 
of  the  true  BER.  The  number  of  samples  required  using  conventional  Monte  Carlo 
techniques  can  result  in  unacceptable  simulation  times  for  low  probability  events. 
Importance  Sampling  is  a  method  of  reducing  the  number  of  samples  required  to 
determine  an  estimated  BER  with  the  same  accuracy  and  confidence  as  conventional 
Monte  Carlo. 
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Implementation  of  the  Modified  Monte  Carlo 
Technique  Using  Importance  Sampling 
on  the  Block  Oriented  System  Simulator 


/.  Introduction 


1.1  Background 

Since  communications  systems  have  become  more  complex,  analytical  ap¬ 
proaches  to  evaluating  these  systems  have  become  difficult,  if  not  impossible(9:89). 
The  need  to  use  simplifying  assumptions  to  analyze  modern  communication  systems 
analytically  often  leads  to  an  incorrect  and  misleading  evaluation.  Engineers  have 
turned  to  simulators  to  evaluate  communications  system  performance.  However,  as 
the  performance  of  communication  systems  improve,  the  evaluation  process  becomes 
more  difficult  because  of  the  increasing  system  complexity  and  more  time  consum¬ 
ing  because  more  samples  are  recjuired  to  be  generated  by  the  simulator.  The  time 
needed  to  run  a  simulation  is  directly  related  to  the  number  of  samples  required  by 
the  simulation  to  determine  the  performance. 

As  the  number  of  recjuired  samples  increase,  the  simulation  time  increases  to 
an  unacceptable  level.  Techniques  liave  been  developed  to  permit  a  known  number 
of  system  c^’rors  to  determine  the  performance  within  an  acceptable  margin  of  error. 
As  communications  systems  improve,  this  method  of  evaluating  the  performance  be¬ 
comes  too  time  consuming.  The  need  to  further  reduce  the  amount  of  time  required 
to  run  a  simulation  led  to  the  develo{)ment  of  using  probabilistic  assumptions  in 
the  communications  system  model.  These  a.ssumptions  reduce  the  number  of  sam- 
ph's  required  to  remain  within  the  same  margin  of  error,  and  therebv  decr('ase  the 
simulation  tiTiie. 
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The  bit  error  probability,  or  bit  error  rate  (BER),  in  a  digital  communication 
system  is  an  important  measure  of  system  performance(2;1916).  The  BER  is  a 
measure  of  how  many  bits  arc  likely  to  be  received  in  error  divided  by  how  many 
bits  are  received. 

1.1.1  Computer  Simulation  Evaluation  Method.  With  the  availability  of  sim¬ 
ulation  packages,  the  use  of  computers  to  simulate  and  evaluate  the  performance  of 
communications  systems  has  become  commonplace(3:153).  The  speed  and  ability  of 
the  computer  to  perform  complex  repetitive  mathematics  eliminates  the  need  for  us¬ 
ing  simplifying  assumptions  in  the  communications  system  model(8:T26).  Relieving 
the  engineer  of  tedious  mathematical  calculations  permits  more  time  to  be  devoted 
to  design,  rather  than  number  crunching(  1:1). 

The  fundamental  approach  of  computer  simulation  evaluation  of  communica¬ 
tion  systems  is  to  consider  the  output  of  the  simulation  as  a  series  of  independent 
events.  The  independent  events  are  the  input  signal  and  the  communication  systems 
response  to  that  input  signal.  The  model  of  the  communication  system  is  known  and 
entered  into  the  simulator.  The  .  irnulator’s  task  is  to  generate  samples  of  the  input 
signal  and  process  those  samples  through  the  communication  system  model.  The 
model  usually  consists  of  a  transmitter,  a  receiver,  and  a  medium  to  carry  the  signal 
from  transmitter  to  receiver.  At  th<  medium  stage,  a  noise  signal  is  added  to  the 
desired  signal.  The  noise  signal  corrupts  the  data  signal  and  causes  the  received 
signal  to  be  different  from  the  transmitted  signal.  The  processed  samples  out  of  the 
receiver  are  stored  as  the  rec(>ived,  or  output,  signals  of  the  communication  system. 

The  received  signals  are  compared  to  the  knowti  input  signals  and  any  dif- 
h'rences  arc'  counted  as  errors.  Dividing  the  number  of  errors  by  the  total  numbc'r 
of  samples  yields  an  estimate  of  tlu’  BI'IR.  As  the  number  of  samples  increases  to 
infinity,  the  estimated  BER  api)roaches  the  tine  BER.  Since  the  time  in  observing 
an  infinite  number  of  trials  would  nevc'r  ('iid,  the  process  of  finding  the'  true  value'  of 
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the  BER  is  not  possible.  Therefore,  the  Monte  Carlo  technique  was  created  to  find 
an  estimated  BER  accurate  within  an  acceptable  range. 

1.1. 1.1  Monte  Carlo  Technique.  Monte  Carlo  techniques  are  used  to 
reduce  the  number  of  recpiired  simulation  samples,  and  thereby  reduce  the  time 
needed  to  measure  the  BER.  In  the  Monte  Carlo  technique  of  estimating  the  prob¬ 
ability  of  bit  error,  enough  samples  are  gener'*ted  such  that  a  degree  of  confidence 
can  be  assumed  that  the  estimate  of  ^he  BER  is  approaching  the  true  BER.  In  gen¬ 
eral,  a  minimum  of  samples,  where  is  the  true  BER,  must  be  observed 

before  there  is  an  acceptable  degree  of  confidence  in  the  observed  value  of  the  BER 
estimate(9:93)(3;157).  The  samples  define  a  confidence  interval  where  the  es¬ 

timated  BER  will  range  from  one  half  to  twice  the  actual  BER.  This  interval  is 
considered  an  acceptable  uncertainty(3;157). 

Random  number  generators  in  simulators  generate  the  signals  used  for  com¬ 
munication  system  models.  The  input  signal  for  digital  systems  is  random  data 
where  all  possible  signal  values  occur  with  an  equal  probability.  The  noise  input 
used  for  communications  systems  is  additive  white  gaussian  noise  (AWGN).  The 
amplitude  of  the  noise  occurs  according  to  the  Gaussian  probability  density  function 
(pdf).  Samples  of  the  Gaussian  pdf  are  generated  by  a  random  number  generator, 
added  to  the  desired  signal  in  the  transmission  medium,  and  processed  through  the 
communication  system  model  by  the  simulator.  A  communication  system  with  an 
expected  BER  of  10“®  requires  10'  samples  to  be  processed  before  sufficient  errors 
can  be  counted  to  arrive  at  an  acceptable  confidence  level  in  the  BER  estimate.  As 
an  example,  about  2  1/2  days  are  required  to  run  a  simulation  of  10'  samples  using 
the  Block  Oriented  Systems  Simulator  (BOSS)(  13:5-2). 

I  he  time  required  to  ev'aluate  the  performance  of  a  system  requir  g  a  large 
number  of  samples  must  be  r  luced.  One  method  of  reducing  the  simulation  time 
is  to  modify  the  noise  input  signal  to  make  errors  occur  more  frequently.  I'he  data 


is  then  manipulated  to  remove  the  effect  of  the  biased  input.  Using  a  modified 
probabilistic  input  noise  signal  is  referred  to  as  the  Modified  Monte  Carlo  technique 
using  Importance  Sampling. 

1.1. 1.2  Modified  Monte  Carlo  Technique.  Modified  Monte  Carlo  simu¬ 
lation,  using  Importance  Sampling,  is  a  method  of  reducing  the  number  of  samples 
required  to  estimate  the  BER.  Importance  Sampling  biases  the  Gaussian  noise  pdf 
to  increase  the  rate  at  which  errors  occur.  The  simulator  compares  the  signal  input 
and  signal  output  and  decides  if  an  error  has  occurred.  The  simulator  then  deter¬ 
mines  the  weight  of  the  noise  during  the  symbol  that  caused  the  error  to  occur.  The 
errors  are  counted  using  these  weights.  The  effect  of  biasing  the  input  pdf  is  removed 
by  this  weighting  and  an  estimated  BER  is  determined.  Reducing  the  number  of 
samples  reduces. the  time  required  to  run  a  simulation.  Theoretically,  using  Impor¬ 
tance  Sampling  can  result  in  significant  reduction  in  the  number  of  required  samples 
and  still  achieve  the  same  level  of  confidence  for  a  simulation  using  the  conventional 
Monte  Carlo  technique. 

1.2  Problem 

In  evaluating  the  performance  of  communication  systems,  a  key  parameter  is 
the  probability  of  bit  error.  Because  of  the  complexity  of  current  communication 
systems,  computer  simulation  is  used  to  evaluate  the  BER.  The  Monte  Carlo  tech¬ 
nique  is  used  to  determine  the  BER  within  an  acceptable  range.  The  Modified  Monte 
Carlo  technique  using  Importance  Sampling  is  one  method  to  reduce  the  number  of 
samples  required  to  evaluate  the  BER  within  an  acceptable  range. 

The  Block  Oriented  Systems  Simulator  (BOSS)  does  not  support  any  sample 
reduction  method  to  reduce  simulation  time.  This  purpose  of  this  thesis  is  to  imple¬ 
ment  the  Modified  Monte  Carlo  technique  using  Importance  Sampling  on  the  BOSS 
simulator. 
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1.3  Scope 


The  Block  Oriented  Systems  Simulator  (BOSS)  will  be  used  to  simulate  the 
communication  system  and  evaluate  the  BER  using  the  conventional  Monte  Carlo 
technique  and  the  Modified  Monte  Carlo  technique  with  Importance  Sampling.  Im¬ 
portance  Sampling  will  be  the  only  type  of  sampling  used  in  the  Modified  Monte 
Carlo  simulation.  Other  sampling  methods  such  as  tail  extrapolation,  extreme- value 
or  quasi-analytical  will  not  be  used. 

The  Gaussian  pdf  will  be  the  only  input  noise  type  considered  in  this  thesis. 
The  principal  simulation  parameter  to  be  changed  in  the  all  simulations  will  be  the 
random  number  generator  seeds.  No  other  signal  parameter  biasing  will  be  used. 
The  performance  factor  of  the  communication  system  to  be  measured  and  compared 
is  the  BER. 

All  simulations  will  be  performed  using  baseband  signals  to  speed  up  the  in¬ 
dividual  simulations.  The  communication  system  used  will  be  simple  for  ease  in 
understanding.  The  system  will  be  set  up  using  common  modulators,  demodulators, 
filters,  and  number  generators. 

1.4  .Approacfi/Metliodology 

A  digital  communication  system  with  a  BER  of  about  10“^  will  be  modeled.  A 
conventional  Monte  Carlo  simulation  of  the  communication  system  will  be  run  using 
Gaussian  amplitude  distributed  noise  with  a  variance  of  one  as  the  noise  sequence  to 
establish  a  baseline.  Ten  simulations  will  be  made  varying  the  seeds  of  the  random 
number  generators.  From  the.se  runs  a  normalized  error  of  the  estimated  BER  will 
be  determined. 

The  communication  .system  will  be  modified  to  include  the  modules  for  using 
the  Modified  Monte  Carlo  technique.  The  variance  of  the  Gaussian  noise  signal  will 
be  changed.  As  before,  ten  simidations  will  be  made  using  flifferent  seeds  for  the 
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random  number  generators  and  and  the  normalized  error  will  be  determined.  The 
sample  reduction  will  be  determined  that  maintains  the  same  level  of  uncertainty  as 
the  conventional  Monte  Carlo  method. 


1.5  Equipment 

The  equipment  used  in  this  thesis  is  that  necessary  to  run  the  simulation: 

•  BOSS  User’s  Manual 

•  BOSS  Software  Version:  ST*AR  2.02 

•  DEC  VAXstation  3 
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11.  Communication  System  Simulation 


The  central  issues  in  the  design  of  communication  systems  are  performance 
evaluations  and  tradeoff  analysis(8:r26).  The  vise  of  computer-aided  modeling  or 
analysis  to  evaluate  a  communication  system  depends  on  factors  such  as  system 
complexity  and  required  accuracy  (8:126).  Except  for  some  idealized  and  often  over¬ 
simplified  cases,  it  is  extremely  difficult  to  evaluate  the  performance  of  complex 
communication  systems  using  analytical  techniques  alone(10:5).  Analytical  tech¬ 
niques  are  viable  only  under  limited  circumstances,  and  the  network  being  modeled 
must  often  be  unduly  distorted  to  fit  a  model  amenable  to  analytical  solution(8:126). 
In  fact,  because  of  the  distortions  introduced  to  the  system  model,  often  one  can 
wind  up  with  the  right  solution  to  the  wrong  problem(8:T26). 

It  has  become  increasingly  common  to  use  computer-aided  techniques  to  es¬ 
timate  the  performance  of  digital  communication  systoms(3:153).  Simulation  is  a 
powerful  tool  for  evaluating  the  performance  of  communication  systems(8:T26).  Sim¬ 
ulation  is  often  the  only  viable  method  to  evaluate  systems  where  the  complexity 
is  too  ini'olved  and  analytical  techniques  are  too  difficult(8:126).  Some  major  ad¬ 
vantages  of  analysis  using  simulation  over  analytical  techniques  are  that  simula¬ 
tions  are  more  accurate  and  the  engineer  is  freed  from  tedious  number-crunching 
calculations(8:126). 

This  chapter  is  a  summary  of  computer  simulation  techniques  as  these  tech¬ 
niques  apply  to  communication  systems.  The  first  section  is  an  overview  to  model¬ 
ing  communications  systems.  The  next  two  sections  will  describe  the  Monte  Carlo 
method  and  the  Modified  Monte  Carlo  method  using  Importance  Sampling  as  the 
evaluation  techniques.  Next,  general  features  of  simulation  software  packages  are 
presented.  Finally,  the  features  of  the  Block  Oriented  Systems  Simulator  (BOSS), 
the  simulator  used  in  this  thesis,  are  summarized. 


2.1  Siimdation  Approach 

Four  major  steps  are  fundamental  to  the  simulation  of  any  communication 
system.  These  steps  include  creating  and  storing  the  sampled  representation  of 
the  signal,  filtering  the  sampled  signal,  operating  on  the  signal  according  to  channel 
nonlinearities,  and  demodulating  the  signal  to  observe  the  effect  of  the  channel(9:89). 
These  steps  will  be  discussed  in  terms  of  an  elementary  communication  channel  as 
shown  in  Figure  2.1. 


Figure  2.1.  Elementary  Communication  Channel  (9:90) 

2.1.1  .Signal  Generation.  The  first  step  of  a  simulation  is  to  create  a  set  of 
sampled  signals.  The  sampled  signals  are  repre.sentative  of  the  real  signals.  In  order 
to  reduce  the  sampling  rate  and  the  simulation  time,  bandpass  signals  are  normally 
represented  by  their  low-pass  eciuivalents  (complex  envelopes)(  1 :3).  A  bandpass 
signal,  x(f).  may  be  represented  by 


•^(f)  =  Xn{t)co.s{2Tefrt)  -  .Vg(/).s??;(2;r/, /) 


(2.1) 


where 


x{t)  =  time  domain  signal 
=  direct  component 
Xqi^t)  =  quadrature  co})iponent 
fc{t)  =  center  frequency  of  the  process 

Using  standard  trigonometric  identities,  the  bandpass  signal  can  be  equivalently 
represented  as 

x{t)  =  R{t)cos[>.K  f^t  +  <h(/)]  (2.2) 

where 

R(t)  =  + 

'*'(<)  = 

The  complex  envelope  of  x(t)  is  then 

X{t)  =  R(t)cxp[jm]  (2.3) 

d'his  representation  of  the  signal  is  known  as  the  complex  low-pass  representa¬ 
tion.  Use  of  the  complex  representation  significantly  reduces  simulation  time  because 
the  center  (carrier)  frequency  is  not  required  in  the  simulation. 

For  a  sampling  frecpiency  /,,  the  complex  envidopi'  representation  is(9:90) 

x{k-dt)  =  A(k  ■  dt)P^^^^xp[j27r(-^)k  +  ■  dt^  (2.4) 

J  S 
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where 


<1>(A-  ■  (If] 

(h 

r 

./;  -  1  ;<ii 
k 


(■(pn  srnts  amplitude  modulation 
|■(pr^s(tlts  phase  modulation 
IS  thf  n  lot  iff  carrier  frequency 
IS  flu  siynal  power 
IS  till  sampling  frequency 
IS  till  sample  index 


The  main  eonsidf'rat  ion  in  select  ing  the  sampling  frequency /*  is  the  total  band¬ 
width  required  around  the  (liannel  carrier  frequency.  In  a  digital  communication 
system,  the  bandwidth  is  determined  by  tlie  frequency  spectrum  of  the  transmitted 
symbol.  Nyciuist's  Sampling  Theorem  states  that  only  2  samples  per  symbol  are 
necessary  to  reconstruct  the  original  signal.  For  simulation  purposes,  the  sampling 
frequency  should  be  an  even  integer  between  8  and  16(9:90).  If  the  sampling  fre¬ 
quency  is  less  than  8  samples  per  symbol,  accuracy  is  lost;  with  more  than  16  samples 
per  symbol,  excess  simulation  time  is  used  without  significant  gain  in  accuracy(9:90). 

2.f.2  Filtering  of  Signals.  The  next  consideration  in  the  simulator  is  the 
use  of  filters  in  the  system.  The  primary  purpose  of  system  filters  is  to  give  an 
acceptable  tradeoff  between  desired  signal  distortion  and  interference  from  adja¬ 
cent  channels(9:91).  The  simulator  requires  a  flexible  capability  to  model  different 
gains/delays  versus  the  frequency  functions(9:91). 

Efficient  algorithms  are  necessary  for  a  simulator  because  filtering  tends  to  be 
the  most  CPU-intensive  aspect  of  the  simulation(9:91).  There  are  three  methods 
usually  used  to  simulate  filter  actions:  1)  convolve  the  sampled  signal  with  a  stored 
filter  impulse  response;  2)  multiply  the  discrete  Fourier  transform  (DFT)  of  the 
signal  by  the  filter  frequency  transform  function  and  take  the  inverse  DFl’  to  return 
the  signal  to  the  time  domain  representation;  and  3)  operate  on  the  signal  according 
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to  the  difference  ecjuation  governing  the  filter(9:91 ).  Direct  convolution,  the  first 
method,  is  rarely  used  because  of  the  excessive  CPU  time  reejuired  to  perform  the 
computations.  The  DFT  approach  is  the  most  general  and  commonly  used  method 
to  simulate  the  effects  of  fdtering.  However,  for  low  order  classical  filters,  such  as 
the  Butterworth  or  Chebyshev,  the  difference  equation  method  is  quicker  than  the 
DFT  method. 

^.L3  Channel  Nonlincarities.  Analytical  approaches  become  complex,  if  not 
impossible,  to  use  when  the  system  model  contains  nonlinearities.  Simulation  is  often 
the  only  practical  approach  to  perform  system  evaluation(9:9‘2).  Most  simulations 
of  devices  with  abrupt  nonlinearities  generate  input/output  tables  to  map  input 
values  to  output  values.  These  lookup  tables  are  used  when  the  simulator  encounters 
abrupt  changes  to  the  input  value  and  interpolation  of  the  data  points  are  used  if 
necessary.  For  gradual  noidinearities  in  the  simulation,  power  series  representations 
of  the  input/output  relationship  are  uscd(9:92). 

2.1./)  Receiver  Stmchire e;.  llie  first  module  in  the  receiver  structure  is  the 
receiver  front-end  fdter.  At  this  point  in  the  model  the  remaining  steps  in  the 
simulation  include  the  addition  of  noise,  demodulation,  and  quantitative  performance 
evaluation(9:93).  Performance  evaluation  would  be  measured  by  the  signal  to  noise 
ratio  for  analog  systems  and  tin*  bit  error  rate  for  digital  systems(9;93). 

bwo  types  of  simulations  are  used  depending  on  whether  thermal  noise,  usually 
Gaussian,  is  added.  The  hybrid  simulation/analysis  approach  is  used  if  thermal  noise 
is  not  added  in  the  simulator.  3  his  approach  uses  simulation  to  obtain  the  statistics 
of  any  other  sources  of  signal  interference  or  distortion.  The  efh'ct  of  thermal  noise  is 
then  added  to  the  statistics  and  an  average  error  rate  is  calculated(9;94).  In  the  direct 
simulation  approach,  thermal  noise  is  added,  <lemodulation  is  pc'rforrned,  and  the 
l^erformance  oi  the  overall  system  is  evaluated,  for  digital  systems,  error  counting  is 
recpiired,  therefore  making  these  simulations  inherently  time-consuming(9:9 1 ).  'Flie 


Monte  Carlo  teclmiciue  is  a  methotl  of  ensuring  that  simulating  a  certain  number 
of  symbols  will  yield  the  estimated  BER  within  a  range  of  accuracy  and  a  level  of 
confidence. 

The  demodvilation  and  detection  processes  reduces  the  waveform  to  a  number 
which  is  then  compared  to  a  threshold.  The  decision  process  can  be  described  in 
relation  to  the  probability  density  functions  (pdf)  foiv,T)  and  /i(n;T),  of  the  input 
voltage  at  the  sampling  instant  r.  The  detection  decision  is  made  relative  to  the  input 
voltage  at  the  sampling  time  r  given  that  a  “one”  or  a  “zero”  was  sent.  Deciding 
a  “one”  was  received  when  a  “zero”  was  sent  occurs  when  there  is  a  large  positive 
excursion  of  the  receive  voltage  from  the  value  of  a  “zero”.  If  the  excursion  of  the 
voltage  is  sufficiently  large  to  exceed  the  threshold  voltage  Vj,  an  error  will  occur. 
Sample  densities  are  shown  in  Figure  2.2.  These  densities  may,  in  general,  assume 
any  shape  and  are  not  necessarily  identical. 


V 

T  tTHHESHOLD) 


Figure  2.2.  Error  Probability(3:15.5) 


d'he  probability  of  error,  given  that  a  one  was  sent,  is 


Prob[error/one]  =  pi 


(2.5) 


The  probability  of  error,  given  that  a  zero  was  sent,  is 


Prob  [error /zero]  =  Po  =  /  fo{^')dv 

J  V'j' 

Tlic  average  probability  is  then 


(2.6) 


P  =  TTiPi  +  TToPo 


(2.7) 


where 


TTi  is  the  a  priori  pi'obability  of  the  symbol  ‘‘‘’one" 

ttq  is  the  a  priori  probability  of  the  symbol  ‘‘‘'zero" 

2.2  Monte  Carlo  Technique 

The  Monte  Carlo  method  is  basically  an  error  counting  technique.  In  other 
words,  the  Monte  Carlo  technique  estimates  the  probability  of  bit  error  by  observ¬ 
ing  the  number  of  error  occurrences.  Suppose  that  a  “zero”  was  sent.  Then  the 
probability  of  error  is 

Po  =  f  fo{v)dv  (2.8) 

Jx'r 

This  may  be  rewritten  as 


/OO 

ho{u)fo(v)dr) 

-OO 

where  ho  is  an  error  detector  given  by 


(2.9) 


I  1,  v>  Vr 
\  0.  r  < 
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Recognizing  that  Equation  2.9  expresses  the  expected  value  of  ho,  the  prob¬ 
ability  of  error  can  be  estimated  with  a  sample  mean  of  Iiq.  In  other  words,  the 
probability  of  er^'or 


po  =  E’[/«o(t’)]  (2.10) 

can  be  estimated  by  counting  the  number  of  errors  over  N  trials  as  given  by 

1  A 

Po  =  (2.11) 

i=i 

where  ho  is  an  error  detector,  the  summation  is  an  error  counter,  u,-  =  v(t,),  and 
is  the  symbol-spaced  instant  at  which  the  decision  is  made. 

Equation  2.11  defines  the  Monte  Carlo  method(3:156).  The  probability  of  bit 
error  is  estimated  by  counting  the  number  of  error  occurrences  over  a  set  of  trials. 
Simplifying  the  above  equation  for  r;  bit  errors  out  of  N  bits  observed  defines  an 
unbiased  Monte  Carlo  estimate  of  the  probability  of  bit  error  p  as 


/3  =  7//N 


(2.12) 


where 


7/  is  the  number  of  errors 
N  is  the  total  number  of  bits 

As  the  number  of  trials  increases  to  infinity,  the  error  probability  estimate  p 
approaches  the  true  error  probability  p.  file  simulation  time  required  for  an  infinite 
number  of  trials  wouhl  never  end  and  is  therefore  unacceptable,  'fhe  Monte  Carlo 
iTO'thod  was  created  in  order  to  find  a  relatively  accurate  estimate  of  j>. 
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In  the  Monte  Carlo  method  of  estimating  the  probability  of  error  p  ,  enough 
errors  need  to  be  counted  to  ensure  that  a  degree  of  confidence  can  be  assumed  that 
the  error  probaliility  estimate  p  is  relatively  close  to  the  actual  error  probability  p. 
The  confidence  level  can  be  defined  as(3;15G) 

P[h-2  <p<  hi]  =  (1  -q)  (2.13) 


w^’ere 


h[  —  /i2  is  the  confidence  interval 

( 1  —  o)  is  the  confidence  level 

In  other  words,  ( 1  -  a)  is  the  probability  that  the  true  value  of  the  BER  p  is  bracketed 
by  hi  and  h^-  Figure  2.3  shows  the  number  of  trials  that  needs  to  be  observed  before 
the  estimate  error  rate  lies  within  a  desired  confidence  level  of  the  actual  error  rate. 

In  general,  a  minimum  of  symbols  should  be  observed  before  there  is  an 
acceptable  degree  of  confidence  in  the  error  estimate  p  (3:157).  This  is  equivalent  to 
a  vertical  slice  on  the  chart  where  N  =  (lO*^'*'’).  Going  across  the  chart  at  the  90% 
confidence  range  shows  that  observing  symbols  defines  a  confidence  interval 

where  the  estimated  error  probability  p  is  in  the  range  of  0.5p  to  2p.  This  interval 
is  considered  acceptable(3: 1 57). 

Figure  2.4  illustrates  the  operations  performed  by  a  Monte  Carlo  simulation. 
The  input  ,r  to  the  processor  is  a  random  variable  of  a.  known  probability  density 
function,  fx{-r).  Using  a  finite  number  of  observations,  we  want  to  estimate  the 
number  of  errors  occurring  in  p.  The  sorting  operation  is  deciding  if  an  error  has 
occurred,  fidu'  output  .r  is  t  he  number  of  errors. 

How('ver.  use  of  the  conva'iitional  Monte  Carlo  technique  is  limited  to  error 
probabilities  in  the  region  of  lt)“^  ,  I0~*  ,  and  possibly  10“''  (9:93).  Vmifying  lower 


Figure  2.3.  CoiifKlence  Bands  Wlien  Observed  Value  is  10  ^  (3:158) 


error  rates  becomes  e.xtremely  time  consuming  becaiuse  of  the  number  of  samples 
the  simulator  is  required  to  generate.  A  variation  of  the  eonventional  Monte  Carlo 
method  using  Importance  Sampling  has  been  developed  to  reduce  the  number  of 
samples  recpiired,  thereby  reducing  the  simulation  time. 

2..2  Modijifd  Montr  Cniio  Technique  Usinq  Importance  Snmphnq 

The  large  number  of  samples  required  to  be  geiu'rated  tor  a  small  numlx'r  of 
('i  rors  to  be  (  (uinted  make  the  Monte  Carlo  method  iiH'lficient .  The  majority  ot 
the  generatc'd  signals  do  not  cause  errors  (tin-  ‘important’'  event).  If  the  noise  is 
/.ero-mean  Caussian.  for  e.xample,  the  most  |)rol)ahle  vahu'  is  zero,  and  zero  will 


Figure  2.4.  Sketch  of  Operations  Perfornied  with  Conventional  Sampling  (6:17) 


not  generate  an  error.  There  i.«  '^nain  range  of  values  centered  around  the  mean 
value  that  also  do  not  contribute  to  error  occurrences.  The  samples  generated  that 
do  not  induce  errors  are,  in  effect,  wasted.  Importance  sampling  is  a  method  of 
making  errors  occur  more  frequently  by  a  deliberate  distortion,  called  biasing,  of  the 
statistics  of  the  underlying  noise  process  that  causes  errors  to  occur(3;158). 

The  probability  of  error  given  a  “zero'’  was  sent,  as  shown  in  hTjuation  2.9,  can 
be  rewritten  as 


(2.14) 


where  /,*(e)  is  the  biased  density  function.  Noise  samples  from  ./o(c)  will  cause  the 
errors  to  occur  more  frefiuently  becau.se,  as  shown  later,  /('  will  be  foriru'd  from  /o 
in  such  a  way  as  to  increase  the  nois<'  pow'er(3;1.7f)). 


2  I  I 


The  ratio 


=  fo{v)/foiv) 


(2.15) 


is  called  the  iveight,  or  “unbiaser”,  of  the  function  and  the  inverse  of  iv{v) 


B{v)  =  10  ^(n)  =  fo{v)/fo{v) 


(2.16) 


is  called  the  bias  of  the  function. 

Equation  2.14  can  be  rewritten  as 


Po 


I 

/ 


—  CO 
CO 


b{,{v)w{v}fQ{v)dv 


(2.17) 

(2.18) 


where  /?o(v)  is  an  error  detector,  not  now  based  on  a  count  of  one  as  in  conventional 
Monte  Carlo,  but  now  based  on  the  weight  iv{v). 

As  shown  in  Section  2.2,  Equation  2.18  may  be  written  as 


Po  = 


(2.19) 


As  before,  the  estimate  of  this  equation  can  be  expressed  as  the  sample  mean 


1 


N. 


Po-  = 

«=i 


^  ^/fo(^’.- )»’(»'.) 


N. 


i  =  ] 


(2.20) 


(2.21) 
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where  Ho{v)  is  identical  to  ho{v)  but  the  changed  symbol  is  a  reminder  that  Ho{v)  is 
the  error  dete«.cor  when  the  biasing  function  /„  is  the  governing  density(3:159).  The 
■■’(ui)  sequence  of  observed  values  is  interpreted  as  the  weighting  function  given  in 
Equation  2.15  evaluated  at  the  sequence  of  observed  voltages  u(f,).  Equation  2.21 
is  the  conceptual  basis  for  producing  an  estimate  using  the  modified  Monte  Carlo 
technique(3:159). 

Figure  2.5  illustrates  the  operations  performed  by  the  Modified  Monte  Carlo 
simulation  using  Importance  Sampling.  As  before  in  Section  2.2,  the  input  x  to  the 
processor  is  a  random  variable  of  a  known  probability  density  function  fx{^)-  Using 
a  finite  number  of  observations,  we  want  to  estimate  the  number  of  errors  occurring 
in  y.  The  sorting  operation  decides  if  an  error  has  occurred.  However,  the  output 
Zm  is  now  the  weighted  number  of  errors. 


F'  igure  2.5.  Sketch  of  Operations  Performed  with  Importance  Sampling  (6:17) 


2.d.l  Biasivg/ Unbiasing  Procedure  Using  Gaussian  Functions.  Let  lu  a 
zero-mean  Caussiaii  random  variable.  The  zero  mean  Caussian  pdf  with  variance 
is 
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f{x)  =  {I  J  \/^cr)exp{—x^  f2a^) 


(2.22) 


For  importance  sampling,  the  Gaussian  noise  pdf  is  changed  to  cause  errors  to 
occur  more  frequently.  The  biasing  function  B{x)  is  defined  as 

B{^)  =  (2.23) 

where  the  variance  of  f{x)  is  unity  and  the  variance  al  of  f‘{x)  is  greater  than 
one  so  errors  will  occur  more  frequently.  If  /^(.t)  is  used  as  the  noise  pdf  rather  than 
the  original  /a’(^),  then  more  samples  will  come  from  the  region  of  interest  (the  tails 
of  the  pdf)(2;1918). 

The  biasing  scheme  suggested  is  (2:1920) 


D{x) 


c 

IhW 


(2.24) 


where  the  constants  c  and  a  are  chosen  such  that  the  new  density  fxi^)  has  unity 
area.  This  means  that 


I  fxi^)dx=[  B{x)f{x)dx  =  I  (2.25) 

J  —  J —<x> 

The  cv  is  optimized  for  the  HER  of  a  particular  system  using(2:1920) 

-(2.4/  +  1)  +  J{2M  +  1)2  +  47’2(1  + 
oioPT  =  - 7^ - (2.26) 

where  M  is  the  memory  in  (he  system  and  T  is  *60  threshold  defiiuxl  by  7’  = 
Q~^{Pb)-  This  means  that 
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c  = 


(2.27) 


1  —  O' 

(27r)“ 

The  weighting  function  io{x)  is  given  by  f  [x) j J* [x)  for  a  single  sample  point. 
From  Equation  2.21,  the  BER  is  estimated  by  counting  the  errors  and  nnbiasing 
each  count  by  the  ratio  of  the  input  densities.  For  the  case  where  there  is  several 
samples  per  symbol  and  the  input  samples  are  independent,  the  weight  of  the  noise 
that  caused  the  error  to  occur  is  given  by(3:160). 

M 

iu{x,)  =  n /-v(a^.-jA)//A'(a;.-jA)  (2.28) 

where  fx  and  are  single  dimensional  (assumed  stationary)  densities,  i  is  the 
symbol  index,  j  is  the  sample  index  within  the  symbol,  and  M  is  the  number  of 
samples  within  the  symbol. 

2.3.^  Estimation  Error.  Associated  with  simulation  is  the  error  of  the  esti¬ 
mated  value  with  respect  to  the  calculated  value.  The  number  of  samples  required 
to  estimate  Pe  by  direct  counting  is(2:1922) 


N  >  (2.29) 

where  e  is  the  normalized  error  of  the  estimated  P^.  Rewriting  Equation  2.29,  the 
normalized  error  is 


c  = 


where  is  the  standcud  deviation  of  the  estimate  P^. 


(2.30) 
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When  computer  simulation  has  been  chosen  to  evaluate  a  communication  sys¬ 
tem,  it  is  important  to  choose  a  simulation  software  package  that  is  both  flexible  and 
accurate. 

2.4  Simulation  Software  Packages 

Several  software  packages  are  now  available  for  simulating  communication  sys¬ 
tems.  The  features  that  make  one  simulation  program  a  better  choice  for  a  particuar 
application  are  not  clear-cut(l;2).  However,  it  is  important  to  understand  the  fea¬ 
tures  that  a  communication  simulation  package  should  have,  and  a  summary  of 
desirable  features  as  identified  by  Balaban  and  Shanmugan  (1)  are  listed  below. 

2.4-1  Modular  Structure.  To  provide  maximum  flexibility,  simulation  soft¬ 
ware  packages  used  for  communication  systems  analysis  and  design  should  have  a 
modular  structure.  Most  simulation  software  packages  in  use  now  are  made  up  of 
four  major  components:  the  model  library,  the  system  configurator,  the  simulation 
exercisor,  and  the  postprocessor.  The  operational  flow  of  a  simulation  package  is 
shown  in  Figure  2.6. 

The  model  library  is  used  to  store  a  set  of  functional  blocks  that  can  be  accessed 
by  the  modeler  to  build  a  system  to  be  simulated.  The  system  configurator  is  used  to 
configure  the  set  of  models  selected  from  the  model  library  in  the  desired  topology. 
The  individual  block  simulation  parameters  may  be  entered  at  the  configuration  level. 
The  simulation  exerciser  generates  the  simulation  sequence  and  stores  histories  of 
events  or  waveforms  that  occur  at  various  points  in  the  communication  system  model. 
Individual  block  simulation  parameters  may  be  entered  and  system  level  simulation 
parameters  must  be  entered  at  the  simulation  exercisor  level.  At  the  conclusion  of  the 
simulation,  the  post  proce.ssor  outputs  are  used  to  verify  if  the  design  requirements 
and  design  constraints  are  met.  Iterations  of  the  simulation  may  be  run  by  varying 
th('  parameters  and  using  the  post |)rocessor  to  compare  the  results. 


TOPOLOGICAL  SYSTEM  DESCRIPTION 
(SIMULATION  LANGUAGE  OR  GRAPHIC  INPUT) 


TIME  DELAYS, 
ETC... 


l''igiir('  2.6.  Oi)erational  Flow  of  a  Simulation  Package 


Siitnilntion  an  ■  -Programming  Language.  The  software  used  in  the  sim¬ 
ulator  should  he  written  in  a  higher  level  programming  language  such  as  Fortran, 
Pascal,  or  (’.  These  languages,  how'ever,  do  not  allow  input  to  the  simulator  via  block 
diagrams,  riierefore,  to  connect  the  block  diagrams  to  the  simulation  e.xercisor,  a 
j)reproccs.sor  simulation  language  is  required. 

Topological  Configuration.  The  configurator  of  the  simulator  software 
[lackage  should  allow  connection  of  the  model  functional  blocks  in  any  topological 
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configuration.  This  feature  permits  maximum  configuration  flexibility,  however,  it 
may  complicate  the  simulator  software  structure. 

2.4.4  Model  Library.  The  usefulness  of  a  simulation  software  package  de¬ 
pends  heavily  on  the  number  of  functional  blocks  contained  in  the  model  library. 
The  model  configurator  should  allow  unlimited  nesting  of  the  blocks  in  the  model 
library  to  permit  any  subsystem  model  to  be  built.  The  user  should  be  able  to  write 
his  own  model,  and  either  enter  it  directly  into  the  system  model  for  simulation  or 
enter  it  into  the  model  library. 

2.4- 5  Time  and  Event  Driven  Simulation.  A  simulator  should  be  designed 
so  that  processing  can  occur  either  at  every  “tick”  of  the  simulation  clock  or  when 
identified  events  occur.  For  maximum  flexibility,  both  options  should  be  made  avail¬ 
able  to  the  user.  Provisions  should  be  made  in  the  simulator  so  that  the  user  can 
designate  model  blocks  either  as  event  driven  or  time  driven. 

2.4- 6  Postprocessor,  i'he  postprocessor  function  of  the  simulator  should  en¬ 
able  the  designer  to  view  the  results  of  the  simulation.  The  postprocessor  should 
allow  the  users  to  draw  direct  cause-and-effect  inferences  about  the  system  opera¬ 
tion.  As  a  minimum,  the  postprocessor  should  perform  functions  of  common  test 
instruments  such  as  spectrum  analyzers,  and  software  utilities  such  as  profilers  of 
resource  utilization.  Statistical  analysis,  as  well  as  graphics  display  routines,  are  also 
essential  for  the  postprocessor. 

2.4.7  User  Interface.  Fhe  simulation  package  should  be  user  friendly.  The 
documentation  provided  with  the  i)ackage  should  be  comprehensive  and  understand¬ 
able.  On-line  documentation,  such  tas  “help”,  should  be  available  and  noncryptic  to 
the  user. 
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2.5  Block-Oriented  Systems  Simulator 

The  Block-Oriented  Systems  Simulator  (BOSS)  provides  an  interactive  envi¬ 
ronment  for  block  oriented  system  analysis  and  design(  12:1-2).  The  BOSS  software 
structure  is  shown  in  Figure  2.7.  BOSS  has  a  rich  environment  of  block  modules  in 
the  model  library.  The  supplied  blocks  are  easily  altered,  enabling  new  blocks  to  be 
designed.  “Primitive”  blocks  may  be  interconnected  to  build  a  new  block.  These 
new  blocks  may  be  added  to  the  model  library. 

BOSS  has  a  hierarchical  method  of  building  systems  to  be  simulated.  BOSS 
performs  consistency  checking  to  ensure  proper  connectivity  between  all  modules 
and  to  verify  valid  input  parameters  are  used. 

When  the  system  to  be  modeled  is  stored  in  the  simulator,  the  parameters  are 
entered  and  the  simulation  is  performed.  The  post  processor  displays  the  data  in 
various  formats.  The  user  decides  what  data  is  to  stored  by  inserting  probes  into 
the  model. 

BOSS  runs  under  the  VMS  operating  system  on  a  DEC  VAX  Station  or  under 
the  UNIX  operating  system  on  the  SUN-3  workstation(12:l-2).  BOSS  provides  high 
resolution  bit  mapped  graphics  (1021  .x  864)  and  uses  both  a  mouse  and  the  keyboard 
for  inputs. 


2- !  0 


Figure'  2.7.  1K)SS  Software'  Stniclure  (12:1-7) 
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III.  Modeling  of  the  System 


The  Block  Oiiented  Systems  Simulator  (BOSS)  provides  for  simulation-based 
analysis  and  design  of  any  communication  system  which  can  be  represented  in  block 
diagram  form(T2:l-2).  Simulation  models  of  systems  to  be  evaluated  are  built  us¬ 
ing  a  hierarchical  block  diagram  approach.  Once  the  system  to  be  modeled  is  ex¬ 
pressed  in  block  diagram  form,  BOSS  supports  a  time-domain,  or  waveform  level 
simulation(12;l-2). 

To  build  a  system  to  test  and  verify  the  Monte  Carlo  technique  and  Importance 
Sampling  using  BOSS,  it  was  decided  to  use  a  simple,  real-valued  Binary  Phase  Shift 
Key  (BPSK)  system  one  ating  at  baseband.  Built-in  BOSS  modules  were  used  in 
the  system  where  <  possible.  Changes  made  to  existing  BOSS  modules  were  kept 
to  a  minimur  ..  BOSS  modules,  systems,  or  parameters  will  be  capitalized  to  set 
them  ap?rt  from  generic  terms.  This  chapter  will  begin  with  building  the  basic 
BPSK  system  and  will  then  evaluate  the  system  using  the  conventional  Monte  Carlo 
method. 

3. 1  BPSK  System  Decomposition 

The  first  step  in  the  BOSS  modeling  process  is  to  perform  a  top-down  de¬ 
composition  of  the  system.  The  blocks  required  for  a  BPSK  system  are  the  data 
generator,  the  BPSK  modulator,  the  channel,  and  the  BPSK  demodulator.  Added 
to  the  model  will  be  an  error  detector  to  identify  errors  and  provide  the  estimated 
BKR.  ddie  next  sections  will  discuss  the  modeling  of  these  blocks. 

3.1.1  Onto  (lenerntor.  BOSS  provides  a  digital  data  generator  in  the  model 
library.  The  ginierator  in  BOSS  is  called  RANDOM  DATA  and  is  located  under  the 
group  DtCn'AL  SOURCKS.  higiire  .'1.1  shows  the  internal  modules  that  make  up 
the  data  generator  moduh'. 


RANDOM  DATA 


O#  1  OUTPUT 


Figure  3.1.  RANDOM  DATA  Internal  Modules 

RANDOM  DATA  generates  a  random  binary  bit  stream  (logical  “true”  or 
“false”)  at  a  specified  bit  rate  and  probability  of  false.  RANDOM  DATA  requires 
the  parameters  shown  in  Table  3.1  to  generate  the  bit  stream. 

Table  3.1.  RANDOM  DATA  Parameters 
ISEED 

PROBABILITY  OF  FALSE 
BIT  RATE _ 

The  parameter  ISEED  is  the  seed  of  the  underlying  random  number  generator. 
The  generator  has  a  uniform  distribution.  ISEED  will  be  renamed  DATA  GENERA¬ 
TOR  SEED  to  differentiate  between  the  different  seeds  in  the  model.  This  parameter 
will  be  passed  up  to  the  system  level  because  the  DATA  GENERATOR  SEED  will 
be  one  of  the  parameters  varied  to  determine  the  estimation  error.  The  parameter 
PROBABILITY  OF  FALSE  will  be  set  internally  in  the  RANDOM  DA'FA  module 
to  be  0..5.  'This  setting  ensures  random  data  is  output  from  the  module.  The  pa¬ 
rameter  Brr  RATE  will  be  renamed  SYMBOL  RATE  and  will  be  passed  up  to  the 
system  model. 
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BPSK  Modulator.  BOSS  provides  a  BSPK  modulator  in  the  model 
library.  The  modulator  in  BOSS  is  called  BPSK  MOD  and  is  located  under  the 
group  DIGITAL  MODL’LATORS.  Figure  3.2  shows  the  internal  modules  that  make 
up  the  modulator  module. 


BPSK  MOD 
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Figure  3.2.  BPSK  MOD  Internal  Modules 


T'he  BOSS  module  BPSK  MOD  modulates  the  input  bit  stream  to  the  constel¬ 
lation  of  (1,0)  and  (-1,0).  In  order  to  set  the  bit  error  rate  to  a  desired  value  later, 
the  values  of  the  constellation  were  changed  to  be  (TRUE  VALUE, 0)  and  (FALSE 
VALLT'kO).  Both  constellation  values  were  set  to  be  real  numbers.  Also,  because  the 
simulation  will  be  run  at  baseband,  the  COMPLEX  SPECTRAL  SHIFTER  block 
was  deleted.  To  differentiate  the  user  generated  module  from  the  BOSS  module, 
the  new  module  is  saved  as  BI’SK  MODULATOR  in  the  group  .MISCELLANEOUS. 
BPSK  MODULAIOR  is  shown  in  Figure  3.3.  This  module  output  is  connected  to 
both  the  channel  input  and  to  the  uncorru])ted  input  of  the  BPSK  demodulator. 
BPSK  .VIODUL.VI’OR  rerjuires  the  parameters  shown  in  I'able  3.2  to  generat('  the 
modulated  bit  stream. 

The  parameters  TRUE  VALUE  and  IvM.SE  VALUE  set  th('  amplitudes  of  tlu' 
logical  data  generator  outputs.  FALSE  VAIJH'l  was  .set  internally  in  module  to  be 
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BPSK  MODULATOR 
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[>  TO  0 
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O#  1  OUTPUT 

Figure  3.3.  BPSK  MODULATOR  Internal  Module 


Table  3.2.  BPSK  MODULATOR  Parameters 

TRUE  VALUE 
FALSE  VALUE 

the  negative  of  TRUE  VALUE.  TRUE  VALLIE  was  passed  up  to  the  system  level 
and  will  be  used  to  set  up  a  predicted  BER. 

3.1.3  Channel.  BOSS  does  not  provide  a  channel  that  was  desired  for  this 
model.  The  channel  for  this  model  requires  a  real-valued  white  noise  generator 
and  an  adder.  BOSS  provides  a  generator  called  GAUSSIAN  R.^NUGEN  under  the 
group  .NOISE  AND  INTERFERENCE.  The  BOSS  module  GAUSSIAN  RANUGEN 
generates  real-valued  Gaussian  whit('  noi,se  with  adjustable  mean  and  variance.  Table 
.3.3  shows  the  parameters  required  to  generated  the  Gaussian  noise. 

Table  3.3.  GAUSSIAN  RAN.GEN  Parametcus 

ISEED 

MEAN 

VARIANCE 
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The  parameter  ISEED  was  renamed  NOISE  GENERATOR  SEED.  VARI¬ 
ANCE  and  NOISE  GENERATOR  SEED  were  passed  up  to  the  systi  n  level.  NOISE 
GENERATOR  SEED  must  be  a  large  odd  integer  and  will  be  varied  to  determine  tlie 
estimation  error.  VARIANCE  will  be  set  to  a  value  of  one  for  conventional  Monte 
Carlo  and  will  be  changed  for  the  Importance  Sampling  module.  MEAN  was  set  to 
0.0  and  stored  in  the  module. 

To  model  the  channel,  a  module  called  CHANNEL  was  generated.  This  mod¬ 
ule  will  input  tne  BPSK  signal,  add  Gaussian  noise  to  the  signal,  and  output  the 
cor’-  pted  BPSK  signal.  Eigure  3.4  shows  the  internal  modules  of  the  user  gener¬ 
ated  CHANNEL.  CHANNEL  parameters  are  the  same  as  GAUSSIAN  RAN_GEN 
parameters  shown  in  Table  3.3. 


CHANNEL 


Phgure  3.4.  CHANNEL  Internal  Modules 


S.I./i  BPSh  Dtmodulator.  BO.SS  ])rovides  a  PSK  (h'lnodulator  and  er¬ 
ror  counter  in  the  model  library.  This  module  is  called  PSK_DEMOD_AND 
ERRORT'OUNTER  ;.nd  is  located  under  the  group  DEMODULA'rORS. 
PSK_DEMOD_AN  1)  ERROIGCOUNTI'IR  internal  modules  are  shown  in  f  igure  3..'). 
However,  the  module  supplied  Iw  BOSS  is  configured  for  comi)l('.\  signals  and  was 


changed  to  work  w'th  real  signals.  The  module  was  further  changed  to  move  the  er¬ 
ror  counter  outside  the  module  so  that  changes  to  incorporate  Importance  Sampling 
would  be  easier.  The  error  counter  changes  are  discussed  in  the  next  section. 


Figure  3.5.  PSK_DEMOD_AND  ERROR-COUNTER  Internal  Modules 


The  BOSS  module  PSK  MATCHED-FILTER  DEMODULATOR  internal  mod¬ 
ules  are  shown  in  Eigure  3.6.  The  integrate  and  dump  integrator  integrates  over  one 
symbol  interval  and  dumps  the  output  at  the  end  of  each  symbol.  The  PSK  DE¬ 
TECTOR  quantizes  the  output  of  the  integrator  to  the  nearest  constellation  point. 
In  other  words,  for  BPSK,  the  PSK  decides  which  constellation  point  the  received 
symbol  represents  by  checking  whether  the  integrator  output  is  greater  than  or  less 
than  zero.  Removing  the  IMAG  OF  COMPLEX  and  REAL  OF  COMPLEX  mod¬ 
ules,  one  INl'EGRATE  .-\.ND_DI^MP  module,  and  adding  a  constant  generator  were 
the  changes  necessary  for  the  demodulator  to  function  for  real-valued  signals.  The 
constant  generator  was  r<'(iuir<'d  for  the  MAKE  COMPLEX  module  input  because 


the  PSK  DETECTOR  requires  a  complex  signal.  The  modified  module  was  saved 
as  REAL  BPSK  MATCHED  FILTER  DEMODULATOR  in  the  group  MISCELLA¬ 
NEOUS  and  is  shown  in  Figure  3.7. 


r 


PSK  MATCHED  FILTER  DEMODULATOR 


Figure  3.6.  PSK  MATCHED_FILTER  DEMODULATOR  Internal  Modules 

The  REAL  BPSK  MATCHED  FILTER  DEMODULATOR  module  requires 
the  parameters  shown  in  Table  3.4.  The  MAKE  COMPLEX  IMAG  INPUT  was  set 
to  zero  and  stored  in  the  module.  Because  the  system  is  real-valued  and  channel 
phase  rotation  does  not  occur,  CHANNEL  PHASE  ROTATION  (DEG)  was  set  to 
zero  and  stored  in  the  module.  PSK  CONSTELLATION  FIRSd'  ANGLE  (DEG) 
was  set  to  180  degrees  and  PSK  MODULA'I'ION  ORDER  was  set  to  2,  both  for 
BPSK,  and  stored  in  the  module.  The  model  has  no  delay  elements  between  data 
generation  and  the  input  to  the  demodulator,  therefore  'I'lME  DEL.4Y  TO  INPUT 
(SE(’)  was  set  to  zero.  SYMBOL  RA'l'E  was  the  only  parameter  carried  u|)  to  tin* 
system  level. 
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REAL  BPSK  MATCHED  FILTER  DEMODULATOR 


l#1  RECEIVED  BPSK  STREAM  O#  1  DEMODULATED  BPSK 


Figures.?.  REAL  BPSK  MATCHED  FILTER  DEMODULATOR  Internal 
Modules 


Table  3.4.  REAL  BPSK  MATCHED  FILTER  DEMODULATOR  Parameters 

MAKE  COMPLEX  IMAG  INPUT 
CHANNEL  PHASE  ROTATION  (DEG) 

PSK  CONSTELLATION  FIRST  ANGLE  (DFXl) 

SYMBOL  RATE 

TIME  DELAY  TO  INPUT  (SEC) 

PSK  MODULATION  ORDER 
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The  changes  were  made  to  PSK J)EMOD_AND  ERROR-COUNTER  and 
stored  as  BPSK  DEMODULATOR  under  the  group  MISCELLANEOUS.  The  BPSK 
DEMODULATOR  module  is  shown  in  Figure  3.8.  Again,  the  only  BPSK  DEMOD¬ 
ULATOR  parameter  to  be  passed  to  the  system  level  is  SYMBOL  RATE. 


Figure  3.8.  BPSK  DEMODULATOR  Internal  Modules 


3.1.5  Error  Detector.  BOSS  provides  an  error  detector  in  the  library.  The 
error  detector  is  located  under  the  group  DEMODULATORS  -  INTERNALS.  Added 
to  the  BOSS  supplied  error  detector  was  a  print  module  .so  the  output  data  would 
include  the  BER  calculation.  Also  added  was  a  block  to  stop  the  simulation  when  a 
certain  number  of  symbols  were  counted.  The  simulation  stopper  module  was  stored 
as  SIM  STOPPER  and  is  shown  in  Figure  3.9.  The  altered  error  counter  was  stored 
as  REAL  ERROR  COb^Nd'ER  and  is  shown  in  Figure  3.10.  'I'his  module  re(|uires 
an  enable  which  is  added  as  shown  in  Figure  3.1 1  and  was  stor('d  as  BPSK  ERROR 


COUNTER.  The  enable  is  required  so  the  error  counter  will  only  be  active  for  the 
sample  at  the  end  of  the  symbol  rather  than  active  for  every  sample. 


Figure  3.9.  SIM  STOPPER  Internal  Modules 


The  BPSK  ERROR  COUNTER  module  counts  the  number  of  times  its  two 
inputs  are  unequal.  The  module  prints  the  number  of  errors,  the  calculated  BER, 
and  the  number  of  symbols.  BPSK  ERROR  COUNTER  requires  the  parameters 
shown  in  Table  3.5. 

Table  3.5.  BPSK  ERROR  COUNTER  Parameters 

PRINT  ESTIMATE  MODULO 
SIM  STOPPER  NUMBER  OF  SYMBOLS 
BIT  RATE 

SYMBOL  FOR  SAMPLE  TIME 
TIME  DELAY  TO  INPUT  (SEC) 


TIME  DELAY  TO  INPUT  is  the  numl)er  of  seconds  of  delay  between  trans¬ 
mission  of  the  first  bit  and  that  bit  appearing  at  the  input  of  the  deniodnlator.  I'lMF 
DELAY  d  o  INPUl'  was  set  to  K)-'^  seconds  because  tlu'  integrate  and  dump  lilh'r 
delays  the  signal  by  one  symbol  duration.  IMtlNl  ES  I  IMA  LE  MODI' LK  is  an  iiqmt 
that  determines  afti'r  how  many  samples  the  BER,  numiter  of  symliols.  and  numlx'r 
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Figure  3.11.  BPSK  ERROR  COUNTER  Internal  Modules 

of  bits  are  calculated  and  saved.  SIM  STOPPER  NUMBER  OF  ERRORS  is  an 
input  that  terminates  the  simulation  when  a  certain  number  of  symbols  are  counted. 
PRINT  ESTIMATE  MODULE  and  SIM  STOPPER  NU.MBER  OF  ERRORS  were 
passed  up  to  the  system  level. 

.y.£  BPSK  System 

The  modules  described  in  Section  3.1  are  connected  to  form  a  BPSK  system 
model.  This  model  was  named  BPSK  SYSTEM  and  stored  in  the  group  SYSTEM. 
Figure3.1‘2  shows  the  interconnecting  of  the  modules.  Table  3.6  shows  the  parameters 
required  by  BPSK  SYSTEM. 

d'he  parameter  STOP-TIME  specifies  the  maximum  value  of  time  (in  seconds) 
for  the  simulation.  Dd’  is  the  time  between  discrete  simulation  signal  samples  (in 
seconds),  d'he  other  parameters  have  been  presented  in  previous  .sections. 

■  t.2.1  D(t(  rmininy  BPSK  System  Internal  ISirnmeters.  Values  for  t  he  |)a- 
rameters  listed  in  I'able  3.6  remain  to  be  determined.  S'l'OP-d'IME  is  not  important 


Figure  3.12.  BPSK  SYSTEM  Internal  Modules 


Table  3.6.  BPSK  SYSTEM  Parameters 
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to  this  system  because  the  simulations  will  be  stopped  by  the  symbol  count,  not  by 
the  simulation  clock.  Therefore,  the  value  of  STOP-TIME  was  set  to  10'^  seconds 
to  ensure  the  simulator  will  run  until  enough  symbols  are  counted.  SYMBOL  RATE 
for  this  simulation  is  arbitrary,  so  a  symbol  rate  of  lOOOHz  will  be  used  for  all  simu¬ 
lations.  DT  is  the  time  between  discrete  simulation  signal  samples  (in  seconds).  As 
explained  in  Section  2.1.1,  the  signal  will  be  sampled  at  a  rate  of  ten  times  the  sym¬ 
bol  rate,  or  10““*  seconds.  SIM  STOPPER  NUMBER  OE  SYMBOLS  and  PRINl 
ESTIMATE  MODULO  are  parameters  that  will  vary  for  different  simulations  and 
will  be  determined  later.  NOISE  GENERATOR  SEED  and  DATA  GENERATOR 
SEED  will  be  the  values  shown  in  Table  3.7.  Parameter  values  for  VARIANCE  and 
TRUE  VALUE  determine  the  expected  system  BER  and  will  be  developed  in  the 
next  section. 


Table  3.7.  NOISE  GENERATOR  SEED  and  DATA  GENERATOR  SEED  Values 


RUN 

NOISE  GENERATOR  SEED 

DATA  GENERATOR  SEED 

1 

1,599,999,999 

1,899,999,999 

2 

1,699,999,999 

1,999,999,999 

3 

1,799,999,999 

2,099.999,999 

4 

1,899,999,999 

1,299,999,999 

5 

1,999,999,999 

1,399,999,999 

6 

2,099,999.999 

1,499,999,999 

'T 

1,299,999,999 

1,599,999,999 

8 

1,399,999,999 

1,699,999,999 

9 

1,299,999,999 

1,899,999,999 

10 

1,199,999,999 

1,999,999,999 

S.2.2  Determining  System  HER.  To  establish  baseline  parameters  for  com¬ 
paring  the  estimated  BER  with  the  calculated  BER,  the  expected  system  BER  had  to 
be  determined.  The  BER  for  an  antipodal  BPSK  system  is  calculated  using)  1  1 :1  oG) 
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where 


Ef,  is  the  energy  per  transmitted  bit 

No  is  the  white  noise  power  spectral  density  amplitude 

and  (5(  )  is  the  well  known  complementar}^  error  function  that  is  tabulated  in  many 
communication  texts  and  is  defined  by 

1  r°o  -(2 

Q{^)  =  e  2  dt  (3.2) 

3.2.2. 1  Determining  Energy  Per  Bit,  Eh-  Assuming  equal  energy  sig¬ 
nals,  the  energy  per  bit  E^  is(ll:157) 

Eb  =  f  sl{t)dt  =  /  sl{t)dt  (3.3) 

Jo  Jo 

For  BPSK,  s{t)  is  the  bit  amplitude  A.  Also,  for  antipodal  BPSK  signals, 
slit)  =  .slit)  =  s^it).  Therefore,  the  energy  per  bit  Eb  is  given  by 

Eb  =  r  A^dt  =  A^T  (3.4) 

Jo 

3. 2. 2. 2  Determining  Noise  Eactor  No-  The  noise  factor  No  is  deter¬ 
mined  by  the  value  of  VARIANCE  entered  and  the  simulation  bandwidth.  The 
Himulation  bandwidth  Bg  is  a  function  of  the  sampling  rate  fg,  where 

and  is  shown  in  Figure  3.13.  The  power,  or  variance  erjy,  in  a  zero-mean,  real-valued, 
Caussiau  random  variable  within  the  simulation  bainlwidth  Bs  is  found  using 


;m.u 
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Figure  3.13.  Simulation  Bandwidth  of  a  Gaussian  Random  Variable 


d'he  value  of  Nq  is  found  from  F>quation  3.6  as 


Ab 


2(VARIANCE) 

Is 


=  2(VARIANCE)(DT) 


(3.7) 


■12. 3  BPSK  SYS  fEM  Simulation  Parameter  Determination.  The  BPSK  SYS- 
M  syst  em  internal  parameters  have  been  determined.  Next,  the  system  will  be 
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baselined  using  the  conventional  Monte  Carlo  technique.  The  system  parameters 
remaining  to  be  determined  are  shown  in  Table  3.8. 


Table  3.8.  BOSS  SYSTEM  Parameters  Remaining  To  Be  Determined 

SIM  STOPPER  NUMBER  OF  ERRORS 
PRINT  ESTIMATE  MODULO 
VARIANCE 

NOISE  GENERATOR  IMAGINARY  SEED 
NOISE  GENERATOR  REAL  SEED 
TRUE  VALUE 
DATA  GENERATOR  SEED 


The  performance  of  the  Monte  Carlo  techniques  are  to  be  evaluated  by  compar¬ 
ing  the  estimated  BER  against  the  calculated  BER.  A  desired  calculated  BER  of  10“® 
was  chosen.  This  BER  value  was  chosen  so  the  simulation  time  of  the  conventional 
Monte  Carlo  technique  would  not  be  excessive.  VARIANCE  and  TRUE  VALUE 
(the  bit  amplitudes)  determine  the  system  BER.  The  parameter  value  VARIANCE 
was  chosen  to  be  one  because  the  the  calculations  are  made  easier  in  the  Importance 
Sampling  section.  Therefore,  the  bit  amplitudes  will  be  set  to  determine  the  system 
BER.  The  value  for  TRUE  VALUE  remains  to  be  determined. 

After  combining  Equation  3.7,  Equation  3.4,  Equation  3.1  and  simplifying,  the 
BER  may  be  rewritten  as 


bp:r  =  Q 


(/t^)(T) 

(VARIANCE)(DT) 


Solving  Equation  3.8  for  the  bit  amplitude  A  yields 


'  (VARIANCE)!  DT) 


\Q-'[BEH)\ 


Substituting  in  the  known  parameter  values  yields 


(3.8) 


(3.9) 
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-I  =  ^  1.349 

3.3  BPSK  SYSTEM  Verification 

The  BPSK  SYSTEM  was  simulated  using  the  parameters  previously  disciM'sed 
to  determine  the  estimated  BER  and  estimation  error.  Ten  simulations  were  ran 
using  the  seed  parameters  listed  in  Table  3.7.  The  results  of  the  runs  are  shown  in 
Table  3.9.  All  simulations  took  about  2  hours  and  54  minutes  to  run. 

Table  3.9.  BPSK  SYSTEM  Using  Conventional  Monte  Carlo  Technique  Results 


RUN 

Pe(10-^) 

1 

1.40 

2 

1.00 

3 

1.60 

4 

1.30 

5 

1.70 

6 

1.30 

7 

1.20 

8 

1.20 

9 

1.30 

10 

2.00 

riie  statistics  of  the  BPSK  SYSTEM  using  conventional  Monte  Carlo  tech- 
niqiK’s  are  shown  in  Table  .4.10.  According  to  Shanmugan(2:191 7),  this  estimator  is 
"good"  Ijecause  the  estimator  error  e  is  less  than  1. 

4'al)le  .4.10.  BPSK  SYSTE.M  Using  Conventional  Monte  Carlo  Technique  Statistics 


Pe(10-^) 

apJ10-«) 

f 

1 .40 

0.84 

2.90 

0.29 

I  Ik'  next  chapter  will  develoj)  the  modules  for  using  the  Modified  Monte  Carlo 
te(:hni(|iu'  using  Im[)ortance  Samjding. 
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IV.  Implementing  Importance  Sampling 


Most  of  the  BPSK  System  model  developed  in  the  previous  chapter  is  un¬ 
changed  using  the  Modified  Monte  Carlo  technique  with  Importance  Sampling.  Mod¬ 
ules  to  implement  Importance  Sampling  will  be  new  modules  that  either  replace 
existing  modules  or  are  added  to  the  system  model.  The  new  system  will  be  called 
MODIFIED  BPSK  SYSTEM.  This  chapter  will  begin  with  building  the  new  mod¬ 
ules,  incorporating  the  new  modules  into  the  system,  and  then  evaluating  the  new 
system  as  the  performance  compares  with  the  old  system. 

4.1  Modified  BPSK  Systc'  Decow  position 

MODIFIED  BPSK  SYSTEM  requires  a  biased  function  generator,  a  w^eight 
generator,  and  an  error  counter  to  calculate  the  estimated  BER.  The  biasing  proce¬ 
dure  is  implemented  by  changing  the  VARIANCE  parameter  in  the  module  CHAN¬ 
NEL.  The  unbiasing  procedure,  however,  requires  adding  a  module  for  calculating 
the  error  “weight”  used  for  unbiasing  the  error  count  value.  An  error  counter  must 
be  added  that  will  accumuiate  the  error  weight  sum  and  use  that  sum  for  calculating 
the  Importance  Sampling  estimated  BER. 

4.1.1  Biased  Noise  Function.  The  biasing  function  B{.t)  was  shown  in  Sec¬ 
tion  2. .3.1  to  be 


B{.r) 


.[{■>■) 


t  he  l)iased  noise  function  suggested  is  of  the  form(3:lG!) 


(.1.2) 


'I-l 


where  c  and  a  are  constants  to  be  calculated  so  the  area  under  the  pdf  is  one. 
The  equations  to  determine  the  constants  c  and  a  are  shown  as  Equation2.27  and 
Equation2.26,  respectively. 

Equation  4.2  represents  the  new  noise  to  be  added  to  the  BPSK  signal  in 
the  channel  module.  Equation  2.26,  with  A/  =  10  being  the  number  of  samples 
per  symbol  and  T  =  4.3,  yields  a  =  0.605.  Equation  2.27  shows  that  c  =  0.13. 
Substituting  these  values  into  Equation  4.2,  the  new  noise  pdf  is 


/;•(??)  =  0.25exp(-0.197.5x^)  (4.3) 

This  Gaussian  pdf  has  a  variance  of  2.53. 

The  previous  module  CHANNEL  did  not  need  to  be  modified  to  generate  the 
biased  noise  function.  VARIANCE  was  again  passed  up  to  the  system  level. 

4.1-2  Weight  Generator.  The  weighting,  or  unbiasing,  function  is  represented 
by(4;69) 


This  simplifies  to(4;69) 


w{.v) 


(4.4) 


(/;(.t)  =  {a,/a)ex])[-{l  -  a'^ lal){x‘^ f2)\  (4.5) 

Equation  4.5  represents  the  function  that  determines  the  weight  of  one  noise 
sample  within  a  symbol  interval.  'I  he  module  to  generate  this  weight  function  is 
sliown  in  Figure  4.1. 

WEICirr  CENERAd'OH  retpiires  the  parameters  shown  in  dable  4.1.  MEAN 


was  set  to  0.0  and  VARIANCE  was  set  to  1.0.  ISEED  was  renamed  .NOISE  CEN 
EHATOR  SflEl)  and  was  passed  up  to  the  system  level. 


Figure  4.1.  WEIGHT  GENERATOR  Internal  Modules 


Table  4.1.  WEIGHT  GENERATOR  Parameters 


VARIANCE 

MEAN 

ISEED 

VARIANCE 

MEAN 


This  weight  generator  outputs  a  value  for  the  noise  at  one  sampling  instant. 
Equation  2.28  shows  that  the  weight  of  the  noise  for  one  symbol  interval  is  the 
product  of  the  weights  of  each  noise  sample  in  that  symbol.  WEIGHT  FUNCTION 
GENERATOR,  shown  in  Figure  4.2,  takes  the  value  of  each  noise  sample,  multiplies 
the  value  for  10  samples  (one  symbol),  and  outputs  the  value.  Each  SAMPLE 
&:_HOLD  module  samples  the  value  at  the  symbol  fraction  shown  in  the  input  to 
each  SAMPLE  &_HOLD.  The  TEN  INPUT  MULTIPLIER  multiplies  the  inputs  and 
outputs  the  product  after  10  samples  have  been  taken. 


Figure  4.2.  WEIGHT  FUNCTION  GENERATOR  Internal  Modules 


WEIGirr  FUNCddON  GENERATOR  requires  tlie  parameters  shown  in  Table 
4.2.  NOISE  GENERA  TOR  SEED  will  again  be  passed  nj)  to  the  system  h'vel  to  be 
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varied  to  determine  the  estimation  error.  VARIANCE  and  SYMBOL  RATE  (HZ) 
will  be  passed  to  the  system  level.  TIME  DELAY  TO  INPUT  (SEC)  will  be  set 
to  0.0  because  there  is  no  delay  elements  between  the  sample  generation  and  the 
input  to  the  SAMPLE  &_HOLD  module.  SYMBOL  FRAC  FOR  SAMPLE  TIME  is 
the  parameter  that  determines  which  noise  sample  within  a  symbol  each  SAMPLE 
&:_HOLD  module  samples.  The  SYMBOL  FRAC  FOR  SAMPLE  TIME  parameters 
are  entered  for  each  module  that  inputs  to  each  SAMPLE  &;_HOLD  MODULE. 
These  values  range  from  0.0  to  0.9  in  increments  of  0.1  and  are  shown  for  each 
module  on  Figure  4.2. 

Table  4.2.  WEIGHT  FUNCTION  GENERATOR  Parameters 

NOISE  GENERATOR  SEED 
VARIANCE 

TIME  DELAY  TO  INPUT  (SEC) 

SYMBOL  FRAC  FOR  SAMPLE  TIME 
SYMBOL  RATE  (HZ) 


Jf.1.3  Importance  Sampling  Error  Counter.  Once  the  weight  for  the  noise  in 
each  sample  has  been  determined,  the  error  counter  must  sum  the  values  of  the 
weights  when  each  error  occurs.  The  estimated  BER  is  determined  by  dividing  the 
weight  sum  by  the  number  of  transmitted  symbols. 

Figure  4.3  shows  the  internal  odules  of  the  error  counter  that  determines 
the  estimated  BER  using  Importance  Sampling.  The  module  =REAL  compares  the 
two  inputs  and  determines  if  they  are  eciual  within  a  parameter  called  ALLOWED 
ROUNDOFF  FRACTION.  If  the  inputs  ar('  eriual,  this  module  outputs  ‘true’,  and 
if  the  inputs  are  unequal,  this  module  outputs  ‘false’.  LOGICAL  FO  NUMERIC 
converts  the  true  or  false  outputs  from  th<‘  compare  module  into  numerical  outputs. 
'File  out{)nt  is  set  to  0.0  when  the  inputs  are  e(|ual,  and  1.0  whi’ii  the  inputs  are 
un(’(|ual.  Fhe  multiplier  module  multi|)lie.s  the  error  weight  by  1-0  when  an  ('rror 
has  occured  and  the  RUNNING  SFiM  moduh'  adds  and  store's  tlu'  e'rror  weight  sum. 


That  sum  is  divided  by  the  number  of  transmitted  symbols  to  yield  the  estimated 


IMPORTANCE  SAMPLING  ERROR  COUNTER 


I#  1  INPUT  1 
I#  2  INPUT  2 

I#  3  ERROR  WEIGHT  INPUT 


PRINT 

SIGNAL 

□o 


Figure  4.3.  IMPORl'AXC’F  SAMPLING  ERROR  COUNTER  Internal  Modules 


IMPOin'A.NCE  .SAMPLI.NC  ERROR  COUNTER  requires  the  paraiiH'ters 
shown  in  Table  4.3.  ALLOWED  ROUNDOFF  FRACTION  is  set  to  0.1.  4  RUIl 
VALFl'i  is  set  to  0.0  b(>eause  when  tlu'  input  is  true  means  that  an  (uror  has  not 
occured.  1  he  value  of  th('  noise  during  a  symbol  not  is  error  is  not  of  interest  and 
multiplying  that  erroi-  weight  by  0.0  does  not  inrlurh'  t  hat  value  in  tlx'  running  sum. 
PRl.N  1  SIG.N.AL  1  F.X  1  was  set  to  read  'Probal)ility  of  Importance'  Sam|)ling  HER 
Is;  .  PHl.N  I  l',S  1  IM.A  I  h,  .MODI  LO  was  passed  up  to  the  svste'm  le\('l. 


4-2  Modified  BPSK  System 


The  BPSK  system  developed  in  Section  3.2  was  modified  to  include  the  modules 
developed  in  Section  4.1.3,  Section  4.1.2,  and  Section  4.1.1.  The  model  was  named 
MODIFIED  BPSK  SYSTEM  and  stored  in  the  group  SYSTEM.  Figure  4.4  shows 
the  interconnecting  of  the  modules.  Table  4.4  shows  the  parameters  required  by 
MODIPTED  BPSK  SYSTEM.  All  of  the  parameters  listed  have  been  covered  in 
previous  sections. 

4 . 3  MODIFIED  BPSK  S  YS TEM  Testing 

MODIFIED  BPSK  SYSTEM  was  simulated  using  the  parameters  shown  in 
Table4.5.  NOISE  GENERATOR  SEED  and  DATA  GENERATOR  SEED  were  var¬ 
ied  as  shown  in  Table3.7. 

Table4.6  shows  the  results  of  the  tests.  The  results  are  obviously  not  what 
were  expected.  The  model  has  been  extensively  reviewed,  rebuilt,  and  tested.  Good 
estimated  BER  values  were  never  given  by  the  MODIFIED  BPSK  SYSTEM.  Chapter 
5  will  speculate  why  the  system  does  not  work  and  suggest  some  further  testing  that 
could  be  performed. 


dhbic  4.3.  I.MPORTANCE  SAMPLING  ERROR  COUNTER  Parameters 

ALLOWED  ROUNDOFF  FRACTION 
TRUE  VALUE 
FALSE  VALUE 
PRINT  ESTIMATE  MODULO 
PRINT  SIGNAL  TEXT 


MODIFIED  BPSK  SYSTEM 


Figure  4.4.  MODIFIED  BPSK  SYSTEM  Internal  Modules 


Table  4.4.  MODIEIED  BPSK  SYSTEM  Parameters 

STOP-TIME 
DT 

SIM  .STOPPER  NUMBER  OF  SYMBOLS 
PRINT  ESTIMATE  MODULO 
SYMBOL  RATE  (HZ) 

VARIANCE 

^  NOISE  GENERATOR  SEED 
TRUE  VALUE 
DATA  GENERA'l'OR  SEED 


Table  4.5.  MODIFIED  BPSK  SYSTEM  Test  Parameters 


STOP-TIME 

lelO 

DT 

le  -  4 

SIM  STOPPER  NUMBER  OF  SYMBOLS 

100000 

PRINT  ESTIMATE  MODULO 

10000 

SYMBOL  RATE  (HZ) 

1000 

NOISE  GENERATOR  SEED 

Varied 

TRUE  VALUE 

1.349 

DATA  GENERATOR  SEED 

Varied 

Table  4.6.  MODIFIED  BPSK  SYSTEM  Test  Results 


SYMBOLS 

Pe(10-^) 

t 

4000 

9.1 

8.3 

8000 

16.9 

24000 

29.3 

40000 

35.7 

16.0 
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V.  Conclusions 


This  chapter  will  discuss  the  test  results  of  the  system  using  conventional 
Monte  Carlo  technique  and  the  system  using  modified  Monte  Carlo  technique  with 
Importance  Sampling.  Further,  possible  reasons  for  the  modified  system  not  working 
are  given. 

5.1  Conventional  Monte  Carlo  Technique 

BPSK  SYSTEM  was  tested  using  the  modules  and  parameters  as  explained  in 
Chapter  3.  The  results  of  the  test  are  shown  in  Table  3.9  and  Table  3.10.  The  average 
of  the  estimated  BER  is  1.4X10~^.  The  mean  was  well  within  the  Monte  Carlo 
expected  value  of  0.5X10“®  to  2.0X10“®.  Further,  the  estimator  error  statistic  e  was 
0.29.  Again,  this  was  well  within  the  range  of  0  to  1,  which  shows  the  conventional 
.Monte  Carlo  technique  is  a  good  estimator  of  the  actual  BER. 

However,  conventional  Monte  Carlo  technique  requires  the  simulator  to  gen¬ 
erate  symbols  for  a  BER  of  10“*^.  For  simulations  of  low  probability  events, 

the  time  for  conventional  Monte  Carlo  techniques  become  excessive.  An  extension  of 
the  conventional  Monte  Carlo  technique  is  to  use  Importance  Sampling.  Importance 
Sampling  is  a  method  of  reducing  the  number  of  required  symbols  while  retaining 
the  confidence  levels  of  conventional  Monte  Carlo.  The  results  and  discussion  of 
implementing  Importance  Sampling  follow  in  the  next  section. 

5.2  Modified  Monte  Carlo  Technique  Using  Importance  Sampling 

MODIFIED  BPSK  SYSTEM  was  built  to  include  Importance  Sampling  by 
modifying  the  BPSK  SYSTEM  model.  The  MODIFIED  P^SK  SYSTEM  model 
and  parameters  are  explained  in  Chapter  4.  Some  test  results  are  shown  in  Table 
4.6. 
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The  test  results  received  using  MODIFIED  BPSK  SYSTEM  were  not  the  re¬ 
sults  expected.  The  estimated  BER  started  out  higher  than  expected,  and  then 
gradually  got  worse  as  the  simulation  ran.  The  estimated  BER  should  have  settled 
into  a  value  in  the  same  range  as  the  conventional  Monte  Carlo  technique  did. 

The  model  MODIFIED  BPSK  SYSTEM  was  built  using  the  theory  of  Modi¬ 
fied  Monte  Carlo  simulation  with  Importance  Sampling  as  explained  in  articles  by 
Balaban  and  Shanmugan[2],  Jeruchim[3],  Lu  and  Yao[4],  and  Mitchel[6].  The  arti¬ 
cles,  while  for  the  most  part  similar,  do  differ  in  their  approaches  and  methods  to 
setting  up  an  Importance  Sampling  model. 

The  only  differences  between  the  BPSK  SYSTEM  model  and  the  MODIFIED 
BPSK  SYSTEM  model  are  the  CHANNEL  module,  the  WEIGHT  FUNCTION 
GENERATOR  module,  and  the  IMPORTANCE  SAMPLING  ERROR  COUNTER 
module.  Because  the  BPSK  SYSTEM  model  worked  as  expected,  the  unchanged 
modules  kept  for  the  MODIFIED  BPSK  MODULE  were  not  considered  to  be  caus¬ 
ing  the  faulty  data.  Each  of  the  changed  modules  will  now  be  discussed  as  they  may 
have  contributed  to  the  error. 

CHANNEL  Module.  There  was  no  actual  changes  to  the  CHANNEL 
module.  The  change  was  increasing  the  parameter  VARIANCE  to  make  errors  oc¬ 
cur  more  frequently.  The  fact  that  increasing  the  noise  power  caused  errors  to  occur 
more  frequently  was  evident  in  the  data.  The  value  to  set  the  VARIANCE  param¬ 
eter  to  was  not  clear  in  the  articles.  One  article  optimized  the  VARIANCE  to  2.5 
while  another  article  stated  the  optimum  new  VARIANCE  was  about  4.3^  times  the 
baseline  VARIANCE.  VARIANCES  in  the  range  of  2.0  to  20  in  increments  of  0.2 
were  used  with  no  improvement  of  the  data  shown. 

5.2.2  WEIGHE  EUNCTION  GENERATOR  Module.  The  weight  functions 
were  given  in  the  various  articles  as  either: 
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1.  u;(x)  =  fx{x)lfx{x),  or 


2.  i«(x)  =  [fx{x)]°‘/c,  or 

3.  =  (^)exp[-i(i  - 

which  are  all  equivalent  equations.  This  weighting  function  is  realized  in  the  WEIGHT 
GENERATOR  module.  The  only  question  in  this  function  is  from  where  the  input 
variable  x  is  derived.  The  articles  infer  that  the  variable  x  is  input  from  the  noise 
sample  from  the  biased  Gaussian  pdf.  However,  the  WEIGHT  FUNCTION  GEN¬ 
ERATOR  output  using  that  input  seems  to  have  an  amplitude  too  high  for  the  noise 
sample. 

The  estimated  HER  is  determined  by 


where  r;  is  the  sum  of  the  individual  error  weights  for  each  symbol  and  N  is  the 
total  number  of  bits  counted  in  the  simulation.  Using  conventional  Monte  Carlo,  the 
HER  is  determined  by  dividing  a  relatively  small  number  of  errors  by  a  relatively 
large  number  of  bits.  In  Chapter  3,  on  the  average,  each  test  had  14  errors  for  10® 
symbols.  Using  Modified  Monte  Carlo,  for  the  estimated  HER  p  to  remain  within 
the  expected  Monte  Carlo  range  of  values,  the  number  of  bits  N  would  decrease  by 
the  “sample  saving”.  That  would  mean  that  the  sum  of  the  error  weights  p  would 
decrease  by  the  same  magnitude.  As  an  example  using  the  conventional  Monte  Carlo 
numbers  given  above,  if  the  sample  savings  is  a  magnitude  of  10^,  then 

N 

10-^ 

e=l 

where  W  represents  the  sum  of  the  error  weights  and  e  is  the  index  for  each  error. 
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For  all  simulations,  the  weight  of  each  noise  sample  ranged  from  10~^  to  10® 
with  the  average  noise  sample  value  being  approximately  10®.  This  was  a  discrepancy 
that  can  only  be  explained  by  the  input  variable  x  of  the  weight  function  generator 
being  incorrect. 

The  sample  and  hold  modules  that  pick  out  the  noise  value  at  a  particular 
sample  time  in  the  symbol  worked  correctly.  The  multiply  module  used  to  form  the 
product  of  the  10  sample  noise  weights  functioned  correctly.  The  module  WEIGHT 
GENERATOR  was  tested  using  a  constant  generator  as  the  source,  rather  than  the 
WEIGHT  GENERATOR,  and  the  output  was  as  expected. 

5. 2. 3  IMPORT  A  NCE  SA  MPLING  ERROR  CO  ENTER  Module.  This  mod¬ 
ule  was  generated  from  the  module  REAL  ERROR  COUNTER.  The  only  changes 
were  for  this  module  to  sum  the  error  weights  and  only  output  the  estimated  HER 
for  Importance  Sampling.  This  module  functioned  correctly  when  tested  as  a  stand 
alone  module  with  known  inputs.  The  only  critical  part  of  this  module  is  that  the 
error  occurrence  multiplier  arrive  at  one  input  of  multiply  module  at  the  same  time 
the  error  weight  of  the  noise  that  caused  the  error  arrived  at  the  other  input.  The 
timing  was  confirmed  as  correct. 

5.3  Probable  Problem 

From  the  analysis  performed  in  the  previous  section,  the  problem  must  lie 
in  how  the  weight  of  each  noise  sample  is  determined.  Either  the  weight  function 
equation  is  incorrect  or  the  variable  x  to  put  into  the  weight  equation  was  not 
generated  in  this  module.  Every  reasonable  (and  some  not  so  reasonable)  input  and 
combination  of  inputs  was  used  for  the  variable  x,  all  with  invalid  results. 


5.4  Recommendations 

The  idea  of  using  Modified  Monte  Carlo  simulation  technique  with  Impor¬ 
tance  Sampling  to  simulate  low  probability  events  seems  an  invaluable  tool  for  the 
researcher.  The  following  items  are  recommended  for  further  study: 

1.  Determine  the  problem  with  the  model  derived  to  implement  Modified  Monte 
Carlo  technique  with  Importance  Sampling.  Test  the  model  to  determine  the 
sample  savings  as  a  function  of  system  memory,  BER,  and  variance  of  the  new 
noise  pdf. 

2.  Apply  the  working  model  to  simulations  performed  for  previous  thesis  and 
determine  the  time  saved  and  samples  reduced  using  the  Modified  Monte  Carlo 
technique  with  Importance  Sampling. 

.3.  Generate  a  self-contained  module  that  when  inserted  into  most  simulation  mod¬ 
els  only  requires  the  parameters  of  that  particular  model  be  input.  In  other 
words,  make  the  Importance  Sampling  model  as  “exportable”  as  possible. 
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Abstract 

The  purpose  of  this  effort  was  to  implement  the  Modified  Monte  Carlo  technique  using  Importance 
Sampling  on  the  Block  Oriented  System  Simulator  (BOSS).  In  this  thesis,  computer  simulation  techniques 
of  corrununications  systems  were  reviewed.  Next,  conventional  Monte  Carlo  techniques  and  Modified  .Monte 
Carlo  techniques  using  Importance  Sampling  were  reviewed.  Models  of  Binary  Phase  Shift  Keying  (BPSK) 
systems  using  both  Monte  Carlo  techniques  were  implemented  and  simulated.  Reasons  for  the  model  using 
Importance  Sampling  not  working  correctly  arc  postulated. 

The  Monte  Carlo  technique  is  a  method  of  ensuring  that  an  inherently  infinite  procedure,  such  as  de¬ 
termining  system  bit  error  rate  (BER),  can  be  determined  within  an  appropriate  accuracy  and  a  confidence 
range  after  a  set  number  of  samples.  Conventional  Monte  Carlo  requires  10*  ^  samples  be  generated  to 
determine  a  BER  of  10“*  .  This  number  of  samples  results  in  an  estimated  BER  in  the  range  of  0..5  to  2.0 
of  the  true  BER.  The  number  of  samples  required  using  conventional  Monte  Carlo  techniques  can  result 
in  unacceptable  simulation  times  for  low  probability  events.  Importance  Sampling  is  a  method  of  reducing 
the  number  of  samples  required  to  determine  an  estimated  BER  with  the  same  accuracy  and  confidence  as 
conventional  Monte  Carlo. 

Monte  Carlo,  modified  Monte  Carlo,  importance  sampling.  Block  Oriented  System  71 

Simulator,  conventional  Monte  Carlo,  simulation,  error  weighting,  sample  reduction, 
probability  of  error,  Monte  Carlo,  low  probability  simulation 
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